📚 node [[neural_network|neural network]]
Welcome! Nobody has contributed anything to 'neural_network|neural network' yet. You can:
  • Write something in the document below!
    • There is at least one public document in every node in the Agora. Whatever you write in it will be integrated and made available for the next visitor to read and edit.
  • Write to the Agora from social media.
    • If you follow Agora bot on a supported platform and include the wikilink [[neural_network|neural network]] in a post, the Agora will link it here and optionally integrate your writing.
  • Sign up as a full Agora user.
    • As a full user you will be able to contribute your personal notes and resources directly to this knowledge commons. Some setup required :)
⥅ related node [[cnns convolutional neural networks]]
⥅ related node [[neural networks]]
⥅ related node [[recurrent neural networks in nlp]]
⥅ related node [[rnns recurrent neural networks]]
⥅ related node [[bayesian_neural_network]]
⥅ related node [[convolutional_neural_network]]
⥅ related node [[deep_neural_network]]
⥅ related node [[depthwise_separable_convolutional_neural_network_(sepcnn)]]
⥅ related node [[feedforward_neural_network_(ffn)]]
⥅ related node [[neural_network]]
⥅ related node [[node_(neural_network)]]
⥅ related node [[recurrent_neural_network]]
⥅ related node [[unsupervised neural networks for detecting fake news]]
⥅ related node [[a mostly complete chart of neural networks]]
⥅ node [[neural-networks]] pulled by Agora

Neural Networks

Go to [[Week 2 - Introduction]] or back to the [[Main AI Page]]

Learn through a process called [[Back-propagation]]

A collection of neurons is called a layer. A layer takes an input and gives an output.

Any neural network will have one input layer and one output layer. A neural network with more than one hidden layer is called a deep network.

How they work

A graphical representation of how a neural network functions

A neural network processes an input vector to a resulting output vector through a model inspired by neurons and their connectivity in the brain.

The model consists of layers of neurons interconnected through weights that alter the importance of certain inputs over others.

Each neuron includes an activation function that determines the output of the neuron (as a function of its input vector multiplied by its weight vector).

The output is computed by applying the input vector to the input layer of the network, then computing the outputs of each neuron through the network (in a feed-forward fashion).

A modern perceptron

The following perceptron takes two inputs [i0, i1], modified by their own weights [w0, w1] and the target neuron's bias [w2] and are then passed through an activation function, in this case a step function [1], a step function saying if input >= 1, output == 1, else output == 0.

Here's a graphical representation of that perceptron

See [[Perceptron Learning]] for more information on training a neural network.

⥅ node [[neural_network]] pulled by Agora

neural network

Go back to the [[AI Glossary]]

A model that, taking inspiration from the brain, is composed of layers (at least one of which is hidden) consisting of simple connected units or neurons followed by nonlinearities.

📖 stoas
⥱ context